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We argue that a quantum annealer at very long annealing times is likely to experience a quasistatic 
evolution, returning a final population that is close to a Boltzmann distribution of the Hamiltonian at 
a single (freeze-out) point during the annealing. Such a system is expected to correlate with classical 
algorithms that return the same equilibrium distribution. These correlations do not mean that the 
evolution of the system is classical or can be simulated by these algorithms. The computation time 
extracted from such a distribution reflects the equilibrium behavior with no information about the 
underlying quantum dynamics. This makes the search for quantum speedup problematic. 


Quantum annealing (QA) |l|-|5|] is a means for solving 
optimization problems using quantum mechanics. Re¬ 
cently, QA processors with up to more that a thousand 
qubits have been developed 6 and tested by many in¬ 
dependent research groups 0H3. The processors are 
designed to implement a transverse Ising Hamiltonian: 

H(s) = -A{s)Y j ^ + B(s)'H p , (1) 

i 

up = ( 2 ) 

i i<j 

where a^ ,z are Pauli matrices acting on qubit i, s = t/t a , 
t is time, t a is the annealing time, hi and Jij are tune¬ 
able dimensionless parameters, and A(s) and B(s) are 
monotonic functions such that A(0) ^ B( 0) « 0 and 
B( 1) » A(l) ss 0 (see Fig. [2Ji). A successful computa¬ 
tion yields the ground state or an acceptable low energy 
eigenstate of Up. 

By now, the presence of quantum mechanics j&i, Q, in¬ 
cluding entanglement 117] and computational benefit of 
multiqubit tunneling |14| has been established in the QA 
processors. However, whether or not quantum mechan¬ 
ics can lead to any scaling advantage (quantum speedup) 
over available classical algorithms remains an open ques¬ 
tion. Recently, there have been many attempts to detect 
signatures of quantum speedup in D-Wave Two (DW2) 
QA processors [SS0. In these studies the processor’s 
performance is compared with some classical algorithms, 
such as simulated annealing (SA), quantum Monte Carlo 
simulation of QA (SQA), or other algorithms. The com¬ 
putation time t c is typically expressed as a function of 
the success probability, which is usually taken to be the 
final ground state probability Pq. Here, we define 

t c = ta/Po, (3) 

which is asymptotically equivalent to the definition used 


jqmva 

in previous publications j 8 Hld, Il8| . For a classical solver 
such as SA or SQA, t a is taken to be proportional to the 
number of sweeps (number of iterations in which all spins 
are updated in a single anneal) [53 . 

One hopes to determine how t c scales with the prob¬ 
lem size N and whether the quantum annealer provides 


a better scaling compared to classical solvers. For prob¬ 
lems with essentially 2 dimensional structure, such as the 
Chimera graph (the native graph of DW2), t c is expected 
to be an exponential function of y/N (i.e., the tree-width 
of the graph). The slope of log(t c ) versus y/N, there¬ 
fore, provides the coefficient in the exponent. Quantum 
speedup then means that the quantum annealer provides 
a smaller slope than other classical solvers. In practice, 
complications arise due to the dependence of the scaling 
curves on t a . Figure [TJa, shows schematically a behav¬ 
ior commonly observed from some annealing algorithms, 
such as SA or SQA. The slope of the curves are small for 
small N , because t a is typically too long for such easy 
problems. The slope increases abruptly at large N re¬ 
flecting the fact that the chosen t a is not long enough to 
find a solution. This makes the asymptotic scaling of the 
algorithm unclear. To deal with this problem, Ref. J$ 
suggests optimizing all of the annealers at each size, i.e., 
finding the optimal t a that minimizes t c for each N. The 
resulting “optimal” curve will be independent of a par¬ 
ticular choice of t a (the blue line in Fig. [[]). 

In practice, QA processors come with their own lim¬ 
itations in terms of control parameters or available an¬ 
nealing schedules. For example, DW2 annealing curves, 
A(s) and B(s), are fixed and the minimum available t a 
is 20 /is, which is typically too long rendering subopti- 
mal computation. In the absence of an optimal scaling, 
it was suggested @, Q to determine an upper bound for 
quantum speedup using a suboptinral scaling. Suppose 
Fig. [TJi is the t c obtained from a quantum annealer with 
the minimum allowed annealing time t a 3 and maximum 
512 qubits (y/N < 23). The red curve in Fig. [lji repre¬ 
sents the experimentally accessible region. It is clear that 
the slope of the red curve in Fig. QJt is not a representa¬ 
tive of the asymptotic performance. If we were allowed 
to decrease t a so that optimization becomes feasible, it 
would have been possible to obtain the blue (optimal) 
curve, which has more slope than the red one. There¬ 
fore, the slope of the measured (red) curve provides a 
lower bound for that of the optimal (blue) curve. 

To acquire more intuition, we plot in Fig. [lj) the suc¬ 
cess probability Pq , by inverting each curve in Fig.[lji and 
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FIG. 1: (a) A sketch of computation time as a function of vN 
for different annealing times t a i < t a 2 < t a 3 - Similar behavior 
has been observed in SA and SQA and conjectured for QA 
@|. The blue line shows scaling of an optimized solver. The red 
line represents the region accessible by a quantum annealer 
with t a > t a 3 and N < 512. (b) The success probability 

for the same system. The optimal curve in (b) is plotted by 
connecting the corresponding tangency points in (a). We have 
assumed T > 0 to correspond better with a realistic quantum 
annealer. At T = 0, the asymptotic probability is flat at 
Po = 1 . 


shifting vertically (since logPo = login — logic). The 
curves in Fig. [T]o tend to overlap at small N, demon¬ 
strating weak dependence of Pq on t a for small N (or 
long i a ). Such a weak dependence, commonly observed 
in both QA and classical algorithms, is an indication of 
quasistatic behavior. In thermodynamics, a system is 
called quasistatic when its time-dependence is very slow 
compared to its relaxation time so that it stays near the 
equilibrium state at all times. Typically, in QA the sys¬ 
tem will follow equilibrium distribution up to some point 
but then starts deviating from equilibrium and the prob¬ 
abilities will all freeze shortly after. If the time between 
the deviation and freezing is short, the final probabilities 
will be close to the equilibrium probability distribution at 
a single (freeze-out) point within the freezing region. To 
demonstrate this behavior numerically, we consider a 16 
qubit problem with hi selected from ±1/3 and Jij from 
±1/3 or —1 uniform randomly. Figure [2 Jd shows (solid 
lines) the 12 lowest energy eigenvalues of H{s) obtained 



FIG. 2: (a) Envelope functions A(s) and B{s) for a DW2 
quantum annealer, (b) The lowest 12 energy levels of a ran¬ 
domly generated 16 qubit problem. Dashed black lines are 
classical energies. Notice that the quantum energy eigen¬ 
values are close to the classical ones at s*. (c) Occupation 
probabilities during the annealing calculated using Redfield 
formalism (circles) and Boltzmann distribution (solid lines), 
assuming T = 40 mK and t a = 20 /xs. All probabilities follow 
the Boltzmann distribution in the quasistatic region (green) 
until they start freezing in the freezing region (yellow) and 
stay constant in the frozen region (blue). All final probabili¬ 
ties are close to the Boltzmann probabilities at the freeze-out 
point s*, marked by the vertical (red) dashed line. 


with realistic A(s) and B(s) plotted in[2ji. The dashed 
black lines represent the corresponding classical energies, 
i.e., eigenvalues of B{s)'Hp. We calculate the occupation 
probabilities using the open quantum (Redfield) master 
equation discussed in Refs. 000. Similar master 
equations have proven to provide good qualitative and 
quantitative descriptions of superconducting QA proces¬ 
sors mm E3, m ■ We assume an ohmic environment 
at equilibrium temperature T = 40 mK with dimen¬ 
sionless coupling constant r] = 0.24. The same model 
with the same parameters was successfully used to ex- 
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plain the experimental data in Ref. 14|. Here, we have 
chosen a larger than normal temperature to deliberately 
populate the excited states, otherwise the desired effects 
would not have been visible. Circles in Fig. repre¬ 
sent the occupation probabilities of the lowest 12 eigen¬ 
states during the evolution. We have also plotted the 
equilibrium probabilities (solid lines) using Boltzmann 
distribution: P E (s)=Z~ 1 e~ En ^P BT , where E n {s) is an 
instantaneous eigenvalue of H(s), ks is the Boltzmann 
constant, and Z=^2 n e~ En ^ s ^ kBT is the partition func¬ 
tion. As can be seen in the figure, the probabilities closely 
follow P E {s) up to almost 2/3 of the evolution (green 
region). As s— >- 1 , A(s) becomes smaller making the ther¬ 
mal relaxation slower. When the relaxation becomes 
too slow, the system stops following equilibrium and the 
probabilities start deviating from Boltzmann until they 
all saturate (freeze). The saturations happen within a 
freezing (yellow) region. If the freezing region is narrow 
enough, then the final probabilities will be close to the 
Boltzmann probability distribution at a single freeze-out 
point s = s*, marked by the red vertical dotted line in 

Fig. m 

Typically, s* depends weakly on t a ■ Let j(s) denote 
the dominant relaxation rate at s. As s— >- 1 , y(s) van¬ 
ishes exponentially due to exponential decay of A(s), 
i.e., 7 (s)~ 7 oe - “ s where 70 and a are problem depen¬ 
dent constants. The freeze-out happens when 7 (s) be¬ 
comes too small compared to therefore no thermal 
transition can happen within the annealing time. This 
mean "foe~ as ~ t” 1 , which yields s* ~ ln(y ot a )/a or 
Po(t a ) ~ Pq [ln( 7 ot Q )/a]. Expanding to linear order 
around s* gives 


Po(t a ) ~ (re/a)ln( 7 0 f a ), (4) 

where k is the expansion coefficient. This weak logarith¬ 
mic dependence is responsible for the asymptotic behav¬ 
ior illustrated in Fig. [TJo. 

Notice in Fig. [2jo that the quantum energy eigenvalues 
(solid lines) at s = s* are not far away from the clas¬ 
sical ones (dashed lines), although earlier they are very 
different. The final probabilities are therefore close to 
a classical Boltzmann distribution, even though the dy¬ 
namics during the evolution are not classical. This can 
explain correlations with SA as reported in, e.g., Ref. 0. 

It has been conjectured that QA can become advan¬ 
tageous over thermal annealing or SA for problems that 
have thin but tall barriers in their energy landscapes iJJ. 
The reason is tunneling through such barriers becomes 
more efficient than thermal excitation over the barrier. 
This is certainly a dynamical effect and not an equi¬ 
librium property. If the source of a possible quantum 
speedup is dynamical, as conjectured, then searching for 
the speedup requires access to such dynamics. In general, 
an equilibrium population is only a function of the energy 
eigenvalues and therefore is independent of the dynamics. 



FIG. 3: Ground state probability as a function of t a for the 
problem instance studied in Fig. [2] The circles are calculated 
using the Redfield master equation calculation with the same 
parameters as in Fig. [2J-. The squares are results of closed sys¬ 
tem calculations. Three regions are distinguished: Coherent, 
where the environment does not have enough time to affect 
the system hence the open and closed system probabilities co¬ 
incide. Non-equilibrium, in which the environment starts to 
occupy the excited states during the evolution, but does not 
have enough time to establish equilibrium. Quasistatic, where 
the evolution is so slow that the system follows equilibrium 
during most of the evolution (as in Fig. [2]c) and Pa depends 
on t a according to ©■ 


For a quasistatic quantum annealer with a sharp freeze- 
out at s = s*, the final ground state population is close to 
Pq (s*), which is only a function of E n (s*). It is clear that 
from such probabilities it is not possible to determine 
how fast the distribution is established. For example, 
consider a hypothetical quantum annealer that can re¬ 
turn a Boltzmann distribution of H(s*) within a constant 
time t a = 0(1) (independent of N) that is much faster 
than any other classical solvers and obviously scales bet¬ 
ter than all of them. Since sampling from a Boltzmann 
distribution is a very hard computational problem, this 
hypothetical quantum annealer (although may never ex¬ 
ist) can provide an incredible quantum speedup for such 
a hard problem. Nevertheless, when assessed based on a 
suboptimal t c , it may scale worse than some optimized 
classical solvers, merely due to the scaling of P E (N). 

We now can return to our original question of whether 
it is possible to determine a bound for quantum speedup 
from suboptimal data. If the measured slope in Fig. [lji 
provides a lower bound for the optimal slope, as it ap¬ 
pears in that figure, then one may know with certainty 
when quantum speedup is not possible. A measured 
(suboptimal) slope being larger than the classical slopes 
means that the optimal slope would be even larger. 
Therefore the optimized QA would scale even worse and 
it can never be able to provide quantum speedup. On 
the other hand, if the measured slope is smaller than 
classical, then no conclusion can be made because there 
is always a possibility that the optimal slope be larger 
than classical. In other words, it is possible to “rule out” 
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FIG. 4: (a) Po and (b) t c as a function of \/TV assuming a 
non-monotonic Po(t a )- The probabilities at t a 2 exceed the 
asymptotic line. The optimal curve in (a) is plotted by con¬ 
necting the corresponding tangency points in (b). 


quantum speedup from a suboptimal performance, but 
it is not possible to prove it. Based on what we dis¬ 
cussed before, if the suboptimal probabilities do not pro¬ 
vide information about the quantum dynamics, then it 
should not be possible to even put a bound on quantum 
speedup, which seems to contradict the above argument. 
To resolve this, we notice that the situation depicted in 
Fig. |TJ) is based on assumptions which may not hold in 
general for QA. For example, it is assumed that the slope 
of each curve at a fixed t a is a monotonically increasing 
function of TV*, or that t c increases with t a at small TV*, 
but decreases at large TV. It is also assumed (implicitly 
in Fig. [lji, but explicitly in Fig. [ljj) that the probability 
Po is a monotonically increasing function of t a . Most of 
these assumptions are based on observations from clas¬ 
sical solvers such as SQA (see e.g., supplementary infor¬ 
mation of Ref. Q) and may even apply to most classical 
solvers. Establishing that they also hold in general for 
QA requires a proof. It is, however, possible to disprove 
them by a counterexample, as we do next. 

As a counterexample, we examine the last assumption 
mentioned above, i.e., Po(t a ) is a monotonically increas¬ 
ing function. We calculate Po as a function of t a for 
the 16 qubit instance of Fig. fusing the Redfield model 
that we used before with the same realistic parameters 
that have shown agreement with experiment 14]. Cir¬ 
cles (squares) in Fig. [3] are results of the master equa¬ 


tion calculations with (without) coupling to the environ¬ 
ment. It is clear that the open system probability be¬ 
haves non-monotonically. For short t ai the environment 
does not have enough time to excite the system from 
the ground state, therefore, the open and closed system 
probabilities coincide (gray region). For intermediate t a , 
the environment starts to populate the excited states 
through a non-equilibrium dynamics and the probabil¬ 
ities decrease (pink region). At long t a , the system starts 
observing quasistatic evolution with an equilibrated final 
population and a Po that increases according to Eq. 0). 
The nonmonotonic i a -dependence is expected to be more 
generic than the chosen example. Since in QA the system 
starts in the ground state, the thermal excitation popu¬ 
lates the excited states from bottom up (unlike the top 
down relaxation in SA). By decreasing t a beyond the re¬ 
laxation time, the thermal processes will not have enough 
time to excite the system, thus Po will increase. When 
annealing becomes so fast that the non-adiabatic exci¬ 
tations become possible, Po will start decreasing a gain . 
Similar behavior has recently been observed in SQA 12. 'll . 

A non-monotonic Po(t a ) may result in a performance 
very different from what is predicted in Fig. [T}r. If we 
allow probabilities to exceed the asymptotic probability 
for small t a in Fig. [TJo, then we may obtain Fig.QJi, which 
leads to a t c plotted in Fig. 0 }d. The plotted optimal line 
in Fig. |4}:> has now a smaller slope than the asymptotic 
one, contradicting the argument used to bound quantum 
speedup. It should be emphasized that the behavior de¬ 
picted in Fig. [|] serves only as a counterexample and we 
do not claim it to be generic for QA. Other situations 
may arise that could be different from both Figs. |T| and 

SI 


It is important to mention that the final probabilities of 
a quantum annealer is not always an equilibrium popula¬ 
tion, even for long t a • Since the relaxation rates between 
different energy levels change differently with time, they 
may freeze at different points during the annealing, lead¬ 
ing to a distributed freeze-out (a wide freezing region in 
Fig. 0)- In such cases, it is not possible to identify a 
single freeze-out point at which the equilibrium popula¬ 
tion gives the final population. Such situations are likely 
to happen when the problem has a complicated energy 
landscape involving numerous valleys with large barriers 
between them. These problems are expected to have final 
populations that are more sensitive to t a and do not cor¬ 
relate with equilibrated QMC simulations. In Ref. 24[,it 
was shown that random problems on the Chimera graph 
have no spin glass phase transition at any nonzero tem¬ 
perature. The lack of spin glass phase transition is an 
indication that the classical energy landscape of the prob¬ 
lem is not very complex, thus equilibration may be easy. 
This signifies the importance of the problem selection for 
any exploration of the role of quantum dynamics in QA, 
as correctly pointed out in Ref. [241. 

To summarize, we have shown that a quasistatic evo- 
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lution with long annealing time can mask the underlying 
quantum dynamics in a quantum annealer. The final 
population of such an annealer is likely to be close to a 
Boltzmann distribution at a single freeze-out point. It 
is therefore expected to correlate well with a quantum 
Monte Carlo simulation equilibrated at the same point 
with a correct temperature. Reference [12] provides in¬ 
dications of such correlations, although QMC was used 
as an annealing algorithm (SQA) with time-dependent 
Hamiltonian (not at a fixed s*), and the used T was 
smaller than the real temperature. This may explain 
why correlations did not persist when considering excited 
states -0- Correlation with SA is also possible (see e.g., 
Ref. [9|), but requires the quantum eigenenergies to be 
close to the classical ones at the freeze-out point. Other 
semiclassical models may also correlate with a quasistatic 
quantum annealer if they reach the same equilibrated 
population (see e.g., Ref. [25[). These correlations are 
signatures of a quasistatic behavior and do not mean 
that the dynamics of the quantum annealer can be sim¬ 
ulated by such algorithms. The lack of access to the rel¬ 
evant quantum dynamics makes the search for quantum 
speedup in a suboptimal quantum annealer Problematic. 
Since one cannot neither prove nor rule out the possi¬ 
bility of quantum speedup, no conclusion can be made 
unless the optimization procedure proposed in Ref. [|j is 
done properly. We should emphasize that our argument 
does not undermine the importance of benchmarking in 
assessing the performance of a quantum annealer, even if 
suboptimal, nor do we claim that a quasistatic quantum 
annealer is not useful. Indeed, providing samples from 
a Boltzmann distribution is a very hard computational 
problem with many applications especially in machine 
learning. However, different benchmarking strategies are 
required to assess QA for such applications [26 ]. 
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